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NON-COOPERATIVE GAMES 


Joun NASH 
(Received October 11, 1950) 


Introduction 


Von Neumann and Morgenstern have developed a very fruitful theory of 
two-person zero-sum games in their book Theory of Games and Economic Be- 
havior. This book also contains a theory of n-person games of a type which 
we would call cooperative. This theory is based on an analysis of the interrela- 
tionships of the various coalitions which can be formed by the players of the 
game. 

Our theory, in contradistinction, is based on the absence of coalitions in that 
it is assumed that each participant acts independently, without collaboration or 
communication with any of the others. 

The notion of an equilibrium point is the basic ingredient in our theory. This 
notion yields a generalization of the concept of the solution of a two-person zero- 
sum game. It turns out that the set of equilibrium points of a two-person zero- 
sum game is simply the set of all pairs of opposing ‘‘good strategies.” 

In the immediately following sections we shall define equilibrium points and 
prove that a finite non-cooperative game always has at least one equilibrium 
point. We shall also introduce the notions of solvability and strong solvability 
of a non-cooperative game and prove a theorem on the geometrical structure of 
the set of equilibrium points of a solvable game. 3 

As an example of the application of our theory we include a solution of a 
simplified three person poker game. 


Formal Definitions and Terminology 


In this section we define the basic concepts of this paper and set up standard 
terminology and notation. Important definitions will be preceded by a subtitle 
indicating the concept defined. The non-cooperative idea will be implicit, rather 
than explicit, below. 

Finite Game: 

For us an n-person game will be a set of n players, or positions, each with an 
associated finite set of pure strategies; and corresponding to each player, 7, a 
payoff function, p; , which maps the set of all n-tuples of pure strategies into the 
real numbers. When we use the term n-tuple we shall always mean a set of n 
items, with each item associated with a different player. 

Mixed Strategy, s; : 

A mixed strategy of player 2 will be a collection of non-negative numbers which 
have unit sum and are in one to one correspondence with his pure strategies. 

We writes; = > a CiaTia With Cia = 0 and J a Cia = 1 to represent such a mixed 
strategy, where the rias are the pure strategies of player 1. We regard the 
s;s as points in a simplex whose vertices are the 7;,’s. This simplex may be re- 
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garded as a convex subset of a real vector space, giving us a natural process of 
linear combination for the mixed strategies. 

We shall use the suffixes 7, 7, k for E and a, B, y to indicate various pure 
strategies of a player. The symbols s; , t; , and r; , etc. will indicate mixed strate- 
gies ; Tia will indicate the ¿it player’s atè pure strategy, ete. 

Payoff function, p; : 

The payoff function, p;, used in the definition of a finite game above, has a 
unique extension to the n-tuples of mixed strategies which is linear in the mixed 
strategy of each player [n-linear]. This extension we shall also denote by 7; , 


writing p:(S1, 82, °°°, Sn). 
We shall write 8% or t to denote an n-tuple of mixed strategies and if s = 
(S1, S2, *** , Sn) then p,(s) shall mean p.(s,, s2,--- , Sn). Such an n-tuple, $, 


will also be regarded as a point in a vector space, the product space of the vector 
spaces containing the mixed strategies. And the set of all such n-tuples forms, of 
course, a convex polytope, the product of the simplices representing the mixed 


strategies. | 
For convenience we introduce the substitution notation (8; ¢;) to stand for 
(Si, S2, °°* , Sit, ti, Si41,°°*, Sn) Where 8 = (s1, 82,---, Sn). The effect of 


successive substitutions ((8; t,;); r;) we indicate by (8; t; ; r;), etc. 

Equilibrium Point: 

An n-tuple $ is an equilibrium point if and only if for every i 
(1) p:(8) = max [p.(8;7,)]. 

all r;’s 

Thus an equilibrium point is an n-tuple % such that each player’s mixed 
strategy maximizes his payoff if the strategies of the others are held fixed. Thus 
each player’s strategy is optimal against those of the others. We shall occasionally 
abbreviate equilibrium point by eq. pt. 

We say that a mixed strategy s; uses a pure strategy Tia if si = È 6 Cigmig 


and Cia > 0. If 8 = (s1, 8%, --+ , Sn) and s; uses Tia we also say that $ uses ria. 
From the linearity of p.(s,, --- , sn) in 8;, 
(2) max [p:(8; rə] = max [pi(8; Tia)]. 
all r;’s 


We define p;2(8). = p;(8; Tia). Then we obtain the following trivial necessary 
and sufficient condition for s to be an equilibrium point: 


(3) p:(8) = Max Pia(8). 
If $ = (S1, S2, +, Sn) and s; = > a CiaTia then p:(8) = >a CiaDia(8), con- 
sequently for (3) to hold we must have cig = 0 whenever p;.(8) < maxs p;a(8), 


which is to say that s does not use r;a unless it is an optimal pure strategy for 
player 7. So we write 


(4) if Tia is used in 8 then pia(8) = ne Die(S) 


as another necessary and sufficient condition for an equilibrium point. 
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Since a criterion (3) for an eq. pt. can be expressed by the equating of n pairs 
of continuous functions on the space of n-tuples 3 the eq. pts. obviously form a 
closed subset of this space. Actually, this subset is formed from a number of 
pieces of algebraic varieties, cut out by other algebraic varieties. 


Existence of Equilibrium Points 


A proof of this existence theorem based on Kakutani’s generalized fixed point 
theorem was published in Proc. Nat. Acad. Sci. U. S. A., 36, pp. 48-49. The proof 
given here is a considerable improvement over that earlier version and is based 
directly on the Brouwer theorem. We proceed by constructing a continuous 
transformation T of the space of n-tuples such that the fixed points of T are 
the equilibrium points of the game. 

THEOREM 1. Every finite game has an equilibrium poini. 

Proor. Let 8 be an n-tuple of mixed strategies, p;(8) the corresponding pay-off 
to player i, and p;.(8) the pay-off to player 7 if he changes to his a pure strategy 
m:a and the others continue to use their respective mixed strategies from 8. 
We now define a set of continuous functions of 8 by 


Pia(B) = max (0, Pia(3) — p:(8)) 
and for each component s; of 8 we define a modification s; by 
Si + 2. O ia(B) Tia 
1 + J Pis) * 


, 
S; = 
calling 3’ the n-tuple (Si, S2, S3" Sh). 

We must now show that the fixed points of the mapping T: 8 — 8’ are the 
equilibrium points. 

First consider any n-tuple 8. In s the 7 player’s mixed strategy s; will use 
certain of his pure strategies. Some one of these strategies, say Tia, must be 
“least profitable” so that Pie(8) < pi(8). This will make Pio(B) = 0. 

Now if this n-tuple 8 happens to be fixed under T the proportion of Tia used 
in s; must not be decreased by T. Hence, for all §’s, g is() must be zero to prevent 
the denominator of the expression defining s; from exceeding 1. 

Thus, if 8 is fixed under T, for any 7 and 8 gi(8) = 0. This means no player 
can improve his pay-off by moving to a pure strategy ig. But this is just a 
criterion for an eq. pt. [see (2)]. 

Conversely, if g is an eq. pt. it is immediate that all 9’s vanish, making $ 
a fixed point under T. | 

Since the space of n-tuples is a cell the Brouwer fixed point theorem requires 
that T must have at least one fixed point 8, which must be an equilibrium point. 


Symmetries of Games 


An automorphism, or symmetry, of a game will be a permutation of its pure 
strategies which satisfies certain conditions, given below. 
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If two strategies belong to a single player they must go into two strategies 
belonging to a single player. Thus if ¢ is the permutation of the pure strategies 
it induces a permutation yw of the players. 

Each n-tuple of pure strategies is therefore permuted into another n-tuple 
of pure strategies. We may call x the induced permutation of these n-tuples. 
Let ¢ denote an n-tuple of pure strategies and p;(£) the payoff to player 7 when 
the n-tuple — is employed. We require that if 


ed then p;(&*) = pi(é) 


which completes the definition of a symmetry. 
The permutation @ has a unique linear extension to the mixed strategies. 
If 


= Ý Ciatia We define (s)? = Ð CialTia)®. 
a Q 


The extension of @ to the mixed strategies clearly generates an extension of 
x to the n-tuples of mixed strategies. We shall also denote this by x. 

_ We define a symmetric n-tuple 3 of a game by 8* = 8 for all x’s 

THEOREM 2. Any finite game has a symmetric equilibrium point. 

Proor. First we note that so = > catia / > a l has the property (so)? = 
Sjo where j = 7”, so that the n-tuple So = (si , S20, *** , Sno) is fixed under any x; 
hence any game has at least one symmetric n-tuple. 

If 83 = (s.,---, Sn) and t = (t,,---, ta) are symmetric then 


s+t Sth tt Sa t+ tn 
2o 2%. 2D 2 nO 


is also symmetric because 8% = 8 <> s; = (s,)*, where j = 7”, hence 


s tt; _ (si)* + t)’ z (= F J 
a 2 2 i 


hence 


This shows that the set of symmetric n-tuples is a convex subset of the space 
of n-tubles since it is obviously closed. 

Now observe that the mapping T: 8 — 8’ used in the proof of the existence 
theorem was intrinsically defined. Therefore, if $: = T8, and x is derived from 
an automorphism of the game we will have 8% = Ts. If 3, is symmetric sf = 
g, and therefore 3X = 7's, = 8, . Consequently this mapping maps the set of 
symmetric n-tuples into itself. 

Since this set is a cell there must be a symmetric fixed point $ aneh must be 
a symmetric equilibrium point. 
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Solutions 


We define here solutions, strong solutions, and sub-solutions. A non-cooper- 
ative game does not always have a solution, but when it does the solution is 
unique. Strong solutions are solutions with special properties. Sub-solutions 
always exist and have many of the properties of solutions, but lack uniqueness. 

Sı will denote a set of mixed strategies of player 7 and ® a set of n-tuples of 
mixed strategies. 


Solvability: 
A game is solvable if its set, &, of equilibrium points satisfies the condition 
(5) (t; r)e > and ge% > (8; r:)¢D for all 2’s. 


This is called the interchangeability condition. The solution of a solvable game 
is its set, ®, of equilibrium points. 

Strong Solvability: 

A game is strongly solvable if it has a solution, ®, such that for all 2’s 


$e and p:(8;r:) = p(s) > (8; r): D 


and then ® is called a strong solution. 

Equilibrium Strategies: 

In a solvable game let S; be the set of all mixed strategies s; such that for some 
t the n-tuple (t; s;) is an equilibrium point. [s; is the 2** component of some 
equilibrium point.] We call S; the set of equilibrium strategies of player 7. 

Sub-solutions: 

If $ is a subset of the set of equilibrium points of a game and satisfies con- 
dition (1); and if & is maximal relative to this property then we call a sub- 
solution. 

For any sub-solution & we define the itt factor set, S;, as the set of all s,’s 
such that ® contains (t; s;) for some t. 

Note that a sub-solution, when unique, is a solution; and its factor sets are the 
sets of equilibrium strategies. 

THEOREM 3. A sub-solution, ®, ts the set of all n-tuples (Sı , S2, *** , Sn) such 
that each si e S; where S; is the 1** factor set of ®. Geometrically, D is the product 
of its factor sets. 

Proor. Consider such an n-tuple (sı , S2, +*+ , $n). By definition dt,,t.,---, 
t, such that for each i (t; ; s;) e &. Using the condition (5) n—1 times we obtain 
successively (ti; si)e ®, (t; 8:3 So) € B,--:, (t; S15 S25 °°: j Se D 
and the last is simply (sı , S2, --- , Sn) € &, which we needed to show. 

THEOREM 4. The factor sets Sı, S2,---, Sn of a sub-solution are closed and 
convex as subsets of the mixed strategy spaces. 

Proor. It suffices to show two things: 

(a) if s; and s; e S: then s; = (s: + s;)/2 e S; ; (b) if s* is a limit point of S; 
then s¥ e S;. 

Let t e &. Then we have p;(t; s;) = p;(t; s: ; r;) and p,(t; s;) = p(t; si 313) 
for any r; , by using the criterion of (1) for an eq. pt. Adding these inequalities, 
using the linearity of p;(s1, +++ , Sa) in s; , and dividing by 2, we get p;(t; s7) = 
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p,(t;s; ;r;) since sř = (s; + s;)/2. From this we know that (t; s;) is an eq. pt. 
for any t e ®. If the set of all such eq. pts. (t;s?) is added to & the augmented 
set clearly satisfies condition (5), and since & was to be maximal it follows that 
S; € S; ; 

To attack (b) note that the n-tuple (t; s*), where te %®, will be a limit point 
of the set of n-tuples of the form (t; s;) where s; e S; , since s¥ is a limit point of 
S;. But this set is a set of eq. pts. and hence any point in its closure is an eq. 
pt., since the set of all eq. pts. is closed. Therefore (t; s#) is an eq. pt. and hence 
s* e S; from the same argument as for s; . 


Values: 
Let be the set of equilibrium points of a game. We define 
vi =. max [p.(8)], v; = min [p:(8)]. 


Se SeH 


If v? = v; we write v; = v} = 0; - v} is the upper value to player i of the game; 
v; the lower value; and v; the value, if it exists. 

Values will obviously have to exist if there is but one equilibrium point. 

One can define associated values for a sub-solution by restricting to the 
eq. pts. in the sub-solution and then using the same defining equations as above. 

A two-person zero-sum game is always solvable in the sense defined above. 
The sets of equilibrium strategies Sı and S» are simply the sets of ‘‘good”’ strate- 
gies. Such a game is not generally strongly solvable; strong solutions exist only 
when there is a “saddle point” in pure strategies. 


Simple Examples 


These are intended to illustrate the concepts defined in the paper and display 
special phenomena which occur in these games. | 
The first player has the roman letter strategies and the payoff to the left, etc. 


Ex. 1 5 aa —3 i 9 To T 10 
Solution (55 a+ b a + 7 8) 


—4 af 4 16°17 
-5 ba 5 —5 1 
3 bg -4 "5 meatg 
Ex. 2 1 aa 1 Strong Solution (b, 8) 
—10 aß 10 
10 ba —10 v =v% = —l1 
—1 b8 —1 
Ex. 3 1 aa 1  Unsolvable; equilibrium points (a, a), (b, 8), 
E = ae and (| + 2, J The strategies in the last case 
1 68 1 have maxi-min and mini-max properties. 


Ex. 4 Strong Solution: all pairs of mixed strategies. 


1 1 
0 1 
1 ba 0 v =v = l, ù = v = 0.. 
0 0 
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Ex. 5 1 aa 2  Unsolvable; eq. pts. (a, œ), (b, 8) and 
E i (z a + Z b, : a + : s). However, empirical tests 
2 bB 1 show a tendency toward (a, æ). 
Ex. 6 l1 aa 1 Eq. pts.: (a, a) and (b, 8), with (b, 8) an example of 
0 aß 0 instability. 
0 ba 0 
0 bB 0 


Geometrical Form of Solutions 


In the two-person zero-sum case it has been shown that the set of “good” 
strategies of a player is a convex polyhedral subset of his strategy space. We 
shall obtain the same result for a player’s set of equilibrium strategies in any 
solvable game. 

THEOREM 5. The sets Sı, So,-+-, Sn of equilibrium strategies in a solvable 
game are polyhedral convex subsets of the respective mixed strategy spaces. 

Proor. An n-tuple 8 will be an equilibrium point if and only if for every 2 


(6) pi(8) = max Pia($) 


which is condition (3). An equivalent condition is for every 7 and a 


(7) pi(8) — pial) 2 0 

Let us now consider the form of the set S; of equilibrium strategies, s; , of 
player j. Let t be any equilibrium point, then (t; s;) will be an equilibrium point 
if and only if s; e S;, from Theorem 2. We now apply conditions (2) to (t; s;), 
obtaining 


(8) s; € 5; <> for all i, a pi(t; s;) — pra(t; s;) 2 


Since p; is n-linear and t is constant these are a set of linear inequalities of the 
form F’;.(s;) 2 0. Each such inequality is either satisfied for all s; or for those 
lying on and to one side of some hyperplane passing through the strategy simplex. 
Therefore, the complete set [which is finite] of conditions will all be satisfied 
simultaneously on some convex polyhedral subset of player 7’s strategy simplex. 
[Intersection of half-spaces.| 

As a corollary we may conclude that S; is s the convex closure of a finite set of 
mixed strategies [vertices]. 


Dominance and Contradiction Methods 


We say that s; dominates s; if p:(t; s;) > p(t; s:) for every t. 

This amounts to saying that s; gives player i a higher payoff than s; no matter 
what the strategies of the other players are. To see whether a strategy s; domi- 
nates s; it suffices to consider only pure strategies for the other players because 
of the n-linearity of p:. 

It is obvious from the definitions that n no equilibrium point can involve a domi- 
nated strategy Si. | 
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The domination of one mixed strategy by another will always entail other 
dominations. For suppose s; dominates s; and t; uses all of the pure strategies 
which have a higher coefficient in s; than in s; . Then for a small enough p 


katt p(s; — 8;) 


is a mixed strategy; and t; dominates t; by linearity. 

One can prove a few properties of the set of undominated strategies. It is 
simply connected and is formed by the union of some collection of faces of the 
strategy simplex. 

The information obtained by discovering dominances for one player may be 
of relevance to the others, insofar as the elimination of classes of mixed strategies 
as possible components of an equilibrium point is concerned. For the ts whose 
components are all undominated are all that need be considered and thus elimi- 
nating some of the strategies of one player may make possible the elimination of 
a new class of strategies for another player. 

Another procedure which may be used in locating equilibrium points is the 
contradiction-type analysis. Here one assumes that an equilibrium point exists 
having component strategies lying within certain regions of the strategy spaces 
and proceeds to deduce further conditions which must be satisfied if the hy- 
pothesis is true. This sort of reasoning may be carried through several stages to 
eventually obtain a contradiction indicating that there is no equilibrium point 
satisfying the initial hypothesis. 


A Three-Man Poker Game 


As an example of the application of our theory to a more or less realistic case 
we include the simplified poker game given below. The rules are as follows: 

(a) The deck is large, with equally many high and low cards, and a hand 
consists of one card. 

(b) Two chips are used to ante, open, or call. 

(c) The players play in rotation and the game ends after all have passed or 
after one player has opened and the others have had a chance to call. 

(d) If no one bets the antes are retrieved. 

(e) Otherwise the pot is divided equally among the highest hands which have 
bet. 

We find it more satisfactory to treat the game in terms of quantities we call 
“behavior parameters” than in the normal form of Theory of Games and Economic 
Behavior. In the normal form representation two mixed strategies of a player 
may be equivalent in the sense that each makes the individual choose each 
available course of action in each particular situation requiring action on his 
part with the same frequency. That is, they represent the same behavior pattern 
on the part of the individual. 

Behavior parameters give the probabilities of taking each of the various 
possible actions in each of the various possible situations which may arise. 
Thus they describe behavior patterns. 

In terms of behavior parameters the strategies of the players may be repre- 
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sented as follows, assuming that since there is no point in passing with a high 
card at one’s last opportunity to bet that this will not be done. The greek letters 
are the probabilities of the various acts. 


First Moves Second Moves 

1 | ° Open on high k Call IIT on low 

B Open on low A Call II on low 

u Call II and III on low 

y Call I on low v Call III on low 
IT | § Open on high £ Call III and I on low 

€ Open on low 

¢ Call I and IT on low Player III never gets a second move 

wl” Open on low 


0 Call I on low 
ı Call II on low 


We locate all possible equilibrium points by first showing that most of the 
greek parameters must vanish. By dominance mainly with a little contradiction- 
type analysis 8 is eliminated and with it go y, ¢, and 6 by dominance. Then 
contradictions eliminate u, £, 1, A, x, and v in that order. This leaves us with 
a, ô, €, and n. Contradiction analysis shows that none of these can be zero or one 
and thus we obtain a system of simultaneous algebraic equations. The equations 
happen to have but one solution with the variables in the range (0, 1). We get 


_ 21 — 321 _ bat _ 5 — 2a _ 4a — 1 
1° " 4 5 +a’ a+ 5) 
These yield a = .308, n = .635, 6 = .826, and £ = .044. Since there is only one 
equilibrium point the game has values; these are © 


(1 + 17a) 1 — 2a 


; 6 


AG Se E = —096 = — 
V1 47 a V2 096 I’ 
and 
79/1 — a 
V3 = .243.= a Ae a 


A more complete investigation of this poker game is published in Annals of 
Mathematics Study No. 24, Contributions to the Theory of Games. There the 
solution is studied as the ratio of ante to bet varies, and the potentialities of 
coalitions are investigated. 


Applications 


The study of n-person games for which the accepted ethics of fair play imply 
non-cooperative playing is, of course, an obvious direction in which to apply this 
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theory. And poker is the most obvious target. The analysis of a more realistic 
poker game than our very simple model should be quite an interesting affair. 

The complexity of the mathematical work needed for a complete investigation 
increases rather rapidly, however, with increasing complexity of the game; so 
that analysis of a game much more complex than the example given here might 
only be feasible using approximate computational methods. 

A less obvious type of application is to the study of cooperative games. By a 
cooperative game we mean a situation involving a set of players, pure strategies, 
and payoffs as usual; but with the assumption that the players can and will 
collaborate as they do in the von Neumann and Morgenstern theory. This means 
the players may communicate and form coalitions which will be enforced by an 
umpire. It is unnecessarily restrictive, however, to assume any transferability 
or even comparability of the payoffs [which should be in utility units] to dif- 
ferent players. Any desired transferability can be put into the game itself instead 
of assuming it possible in the extra-game collaboration. 

The writer has developed a “dynamical” approach to the study of cooperative 
games based upon reduction to non-cooperative form. One proceeds by con- 
structing a model of the pre-play negotiation so that the steps of negotiation 
become moves in a larger non-cooperative game [which will have an infinity of 
pure strategies] describing the total situation. 

This larger game is then treated in terms of the theory of this paper [extended 
to infinite games] and if values are obtained they are taken as the values of the 
cooperative game. Thus the problem of analyzing a cooperative game becomes 
the problem of obtaining a suitable, and convincing, non-cooperative model for 
the negotiation. 

The writer has, by such a treatment, obtained values for all finite two person 
cooperative games, and some special n-person games. 
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